Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: 1927 flex geo json parsing failed #1947

Merged
merged 9 commits into from
Jan 28, 2025

Conversation

qcdyx
Copy link
Contributor

@qcdyx qcdyx commented Jan 24, 2025

Summary:
Closes #1927

Expected behavior:
Added message fields to both MalformedJsonNotice and UnsupportedGeoJsonTypeNotice which already covered
geojson parsing failed.

Update 1/27: added a UnparsableGeoJsonFeatureNotice to cover all failed cases
image

Please make sure these boxes are checked before submitting your pull request - thanks!

  • Run the unit tests with gradle test to make sure you didn't break anything
  • Add or update any needed documentation to the repo
  • Format the title like "feat: [new feature short description]". Title must follow the Conventional Commit Specification(https://www.conventionalcommits.org/en/v1.0.0/).
  • Linked all relevant issues
  • Include screenshot(s) showing how this pull request works and fixes the issue(s)

@qcdyx qcdyx linked an issue Jan 24, 2025 that may be closed by this pull request
Copy link
Contributor

This contribution does not follow the conventions set by the Google Java style guide. Please run the following command line at the root of the project to fix formatting errors: ./gradlew goJF.

@qcdyx qcdyx requested a review from emmambd January 24, 2025 16:19
Copy link
Contributor

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit ee877d8
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1792 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1792 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1792 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1792 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1792 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.67 3.77 ⬆️+0.10
Median -- 1.32 1.41 ⬆️+0.09
Standard Deviation -- 10.71 10.63 ⬇️-0.08
Minimum in References Reports ar-buenos-aires-subterraneos-de-buenos-aires-subte-gtfs-6 0.48 0.61 ⬆️+0.14
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 281.80 277.72 ⬇️-4.08
Minimum in Latest Reports us-california-city-of-wasco-gtfs-1788 0.48 0.48 ⬆️+0.01
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 281.80 277.72 ⬇️-4.08
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 454.75 MiB 466.07 MiB ⬆️+11.32 MiB
Median -- 331.92 MiB 331.92 MiB ⬇️0 bytes
Standard Deviation -- 710.39 MiB 761.83 MiB ⬆️+51.44 MiB
Minimum in References Reports ro-vrancea-consiliul-judetean-vrancea-gtfs-1984 39.98 MiB 40.02 MiB ⬆️+32.00 KiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.51 GiB 10.57 GiB ⬆️+64.28 MiB
Minimum in Latest Reports us-california-thousand-oaks-transit-gtfs-33 53.96 MiB 39.16 MiB ⬇️-14.80 MiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.51 GiB 10.57 GiB ⬆️+64.28 MiB

Copy link
Contributor

This contribution does not follow the conventions set by the Google Java style guide. Please run the following command line at the root of the project to fix formatting errors: ./gradlew goJF.

Copy link
Contributor

This contribution does not follow the conventions set by the Google Java style guide. Please run the following command line at the root of the project to fix formatting errors: ./gradlew goJF.

Copy link
Contributor

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit 57af615
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (3 out of 1801 datasets, ~0%) ✅

Details of new errors due to code change, which is less than the provided threshold of 1%.

Dataset Notice Code
us-colorado-discover-goodwill-gtfs-2043 unparsable_geo_json_feature
us-colorado-senior-resource-development-agency-gtfs-2185 unparsable_geo_json_feature
us-new-hampshire-concord-area-transit-gtfs-2164 unparsable_geo_json_feature
Dropped Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1801 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.64 3.74 ⬆️+0.10
Median -- 1.34 1.41 ⬆️+0.08
Standard Deviation -- 10.33 10.51 ⬆️+0.17
Minimum in References Reports us-massachusetts-massachusetts-area-express-max-gtfs-431 0.48 0.47 ⬇️-0.01
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 275.94 281.95 ⬆️+6.01
Minimum in Latest Reports us-massachusetts-massachusetts-area-express-max-gtfs-431 0.48 0.47 ⬇️-0.01
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 275.94 281.95 ⬆️+6.01
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 458.44 MiB 460.42 MiB ⬆️+1.98 MiB
Median -- 331.92 MiB 331.92 MiB ⬇️0 bytes
Standard Deviation -- 739.53 MiB 756.06 MiB ⬆️+16.53 MiB
Minimum in References Reports us-texas-denton-county-transportation-authority-dcta-gtfs-151 39.57 MiB 407.92 MiB ⬆️+368.35 MiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.49 GiB 10.88 GiB ⬆️+400.98 MiB
Minimum in Latest Reports ro-vrancea-consiliul-judetean-vrancea-gtfs-1984 67.93 MiB 38.35 MiB ⬇️-29.58 MiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.49 GiB 10.88 GiB ⬆️+400.98 MiB

Copy link
Contributor

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit e6e7f90
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1801 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.64 3.78 ⬆️+0.14
Median -- 1.32 1.41 ⬆️+0.09
Standard Deviation -- 10.63 10.67 ⬆️+0.05
Minimum in References Reports us-florida-citrus-county-transit-gtfs-630 0.48 0.61 ⬆️+0.13
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 285.22 284.43 ⬇️-0.79
Minimum in Latest Reports ph-unknown-hm-transport-inc-and-robinsons-malls-gtfs-1105 0.62 0.50 ⬇️-0.12
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 285.22 284.43 ⬇️-0.79
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 466.12 MiB 468.83 MiB ⬆️+2.71 MiB
Median -- 333.92 MiB 331.92 MiB ⬇️-2.00 MiB
Standard Deviation -- 766.38 MiB 774.43 MiB ⬆️+8.05 MiB
Minimum in References Reports us-massachusetts-marthas-vineyard-transit-authority-gtfs-420 39.91 MiB 39.80 MiB ⬇️-119.98 KiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.47 GiB 10.52 GiB ⬆️+52.25 MiB
Minimum in Latest Reports us-california-redding-area-bus-authority-raba-gtfs-114 56.42 MiB 38.86 MiB ⬇️-17.57 MiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.47 GiB 10.52 GiB ⬆️+52.25 MiB

Copy link
Member

@davidgamez davidgamez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Copy link
Contributor

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit 45216c4
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1801 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.62 3.67 ⬆️+0.05
Median -- 1.32 1.34 ⬆️+0.02
Standard Deviation -- 10.44 10.52 ⬆️+0.08
Minimum in References Reports us-massachusetts-massachusetts-area-express-max-gtfs-431 0.46 0.49 ⬆️+0.03
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 276.57 275.32 ⬇️-1.25
Minimum in Latest Reports us-massachusetts-massachusetts-area-express-max-gtfs-431 0.46 0.49 ⬆️+0.03
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 276.57 275.32 ⬇️-1.25
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 461.17 MiB 458.00 MiB ⬇️-3.17 MiB
Median -- 331.92 MiB 333.92 MiB ⬆️+2.00 MiB
Standard Deviation -- 746.38 MiB 722.54 MiB ⬇️-23.83 MiB
Minimum in References Reports ro-vrancea-consiliul-judetean-vrancea-gtfs-1984 38.22 MiB 38.23 MiB ⬆️+4.02 KiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.88 GiB 10.74 GiB ⬇️-149.95 MiB
Minimum in Latest Reports ro-vrancea-consiliul-judetean-vrancea-gtfs-1984 38.22 MiB 38.23 MiB ⬆️+4.02 KiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.88 GiB 10.74 GiB ⬇️-149.95 MiB

@davidgamez davidgamez merged commit 54a572a into master Jan 28, 2025
140 checks passed
@davidgamez davidgamez deleted the 1927-flex-geo_json_parsing_failed branch January 28, 2025 20:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Flex: geo_json_parsing_failed
2 participants